Adapting multiple-choice comprehension question formats in a test of second language listening comprehension

The current study explores the impact of varying multiple-choice question preview and presentation formats in a test second language listening proficiency targeting different levels text comprehension. In between-participant design, participants completed 30-item comprehension featuring implicit explicit information questions under one four conditions. Interactions between preview, participants’ scores were analysed using many facet Rasch analysis. results suggest that measurement ability was directly influenced by questions. Test highest when able to stems before sound file listened options after had completed. However, interactions conditions level only statistically significant an analysis low scoring students’ item responses, which more frequently correct available for information. research underscores importance accounting design making inferences about learners’ will be interest teachers, practitioners researchers developing assessment tasks.